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SAME 



(57) A broadcast reception apparatus Is provided 
with a reception unit for receiving broadcast data as a 
transport stream. The transport stream includes video 
data and a plurality of navigation information 
sequences. Each navigation information sequence 
includes navigation information which includes graphics 
data to be combined with the video data for display. A 
TS (Transport Stream) decoder unit extracts the video 
data and navigation information from the transport 
stream. A reception control unit controls the TS decoder 
unit so that the TS decoder unit extracts navigation 
irtformation from a navigation information sequence 
which is suitable for the the broadcast reception appara- 
tus. A navigation information storage unit stores the 
navigation information extracted by the TS decoder unit. 



A reproduction control unit combines graphics data 
included in the navigation information stored in the nav- 
igation information storage unit with the video data 
extracted by the TS decoder unit and displays a com- 
posite Image of this combination. This achieves a 
broadcast reception apparatus which selectively uses 
necessary pieces of navigation information to display an 
image as a user interface. 
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Description 

FIELD OF THE INVENTION 

This invention relates to a user interface technique 
for a broadcast reception apparatus used in a TV broad- 
cast system. 

BACKGROUND OF THE INVENTION 

Recently, satellite broadcast techniques have 
remarkably been developed. The Japanese Laid-Open 
Patent Application No. 5-284506, "Multimedia Selector 
for Satellite Broadcasts," discloses a technique for pro- 
viding multimedia information being composed of 
images, voices, and digital data by superposing selecta- 
ble pieces of digital data on an analog image signal. For 
example, it is possible with this technique to superim- 
pose a subtitle on a broadcast image, the subtitle being 
one out of a plurality of languages selected by the user 
and being provided as digital data. TTiis enables users 
of a broadcast system to select desired information 
among information transmitted to the users in one direc- 
tion by the broadcast system. In other words, user inter- 
faces are achieved as multimedia information 
transmission systems in which users can select desired 
information. 

However, the above conventional technique dis- 
closes one video stream with one fixed user interface 
(digital data). Such a user interface may not be suited 
for all users. Also, it is impossible for program providers 
in the broadcast system to provide high-level, effective 
programs which are respectively arranged for different 
users since the system transmits only fixed user inter- 
faces. 

DISCLOSURE OF THE INVENTION 

It is therefore an object of the present Invention to 
provide a broadcast reception apparatus which can 
selectively use navigation information to achieve a user 
interlace. 

The above object is achieved by a broadcast recep- 
tion apparatus for receiving broadcast data as a trans- 
port stream, where the transport stream includes video 
data and a plurality of navigation information 
sequences, each of the plurality of navigation informa- 
tion sequences includes navigation information which 
includes graphics data to be combined with the video 
data for display, the broadcast reception apparatus 
comprising: extracting unit for extracting the video data 
and navigation information from the transport stream; 
extract controlling unit for controlling the extracting unit 
so that the extracting unit extracts navigation informa- 
tion from one out of the plurality of navigation informa- 
tion sequences which is related to the broadcast 
reception apparatus; navigation information storage unit 
for storing the navigation Information extracted by the 



extracting unit; and reproduction controlling unit for 
combining graphics data included in the navigation 
information stored in the navigation information storage 
unit with the video data extracted by the extracting unit 
5 and displaying a composite image which is a result of 
this combination. 

The above broadcast reception apparatus may fur- 
ther comprise: operation receiving unit for receiving a 
user operation; and apparatus information storage unit 
10 for storing relationships between operation equipments 
and a plurality of Identifiers of the plurality of navigation 
information sequences, the operation equipments being 
operated by a user to send user operations to the oper- 
ation receiving unit, where the operation receiving unit 
IS includes: a signal receiving unit for receiving a signal 
which specifies one out of the operation equipments 
which is used for the user operation received by the 
operation receiving unit, and the extract controlling unit 
includes: an extract condition setting unit for obtaining 
20 from the apparatus information storage unit an identifier 
of a navigation information sequence which corre- 
sponds to the operation equipment specified by the sig- 
nal received by the signal receiving unit and setting a 
condition for extracting navigation information in the 
2S extracting unit. 

With the above construction, it is possible for the 
broadcast reception apparatus to obtain the navigation 
information which includes graphics data suitable for the 
user since the user type can be identified from the oper- 
30 ation equipment used by the user, achieving a user 
interface in the display image. 

In the above broadcast reception apparatus, each 
of the plurality of navigation information sequences may 
include a plurality of sets of pieces of navigation infor- 
36 mation, the plurality of sets of pieces of navigation infor- 
mation corresponding to respective time periods, and 
each set of pieces of navigation information being 
formed by repeatedly multiplexing a piece of navigation 
information during a corresponding time period, and 
40 where the extract condition setting unit sets a condition 
for extracting navigation information in accordance with 
a time period. 

With such a construction, it is possible to reliably 
achieve a user interface related to the display image. 
45 In the above broadcast reception apparatus, the 
operation equipments may be a remote controller for 
adults and a remote controller for children, and the plu- 
rality of navigation information sequences may be a 
navigation information sequence for adults and a navi- 
50 gation information sequence for children. 

With the above construction, it is possible to 
achieve an optimal user interface since graphics data 
for adults or children is read from the corresponding 
navigation information sequences and is superimposed 
65 on the video image. 

In the above broadcast reception apparatus, each 
piece of navigation information may include display 
position information and time information, the display 
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position information indicating a position for displaying 
graphics data, thie time information indicating a time 
period during which graphics data is displayed, where 
the reproduction controlling unit combines graphics 
data with the video data in accordance with the display 
position information and displays a composite image in 
accordance with the time information. 

With such a construction, it is possible to achieve a 
user interface with a composite image. In the composite 
image, the graphics data is superimposed on the video 
data at an appropriate position and is displayed for an 
appropriate period, the position and period being deter- 
mined in accordance with the video data. 

The above broadcast reception apparatus may fur- 
ther comprise: apparatus information storage unit for 
storing relationships between display screens and a 
plurality of identifiers of the plurality of navigation infor- 
mation sequences, the display screens displaying the 
composite image combined by the reproduction control- 
ling unit, where the extract controlling unit includes: an 
extract condition setting unit for receiving information 
indicating one out of the display screens from the repro- 
duction controlling unit, obtaining from the apparatus 
information storage unit an identifier of a navigation 
information sequence which corresponds to the display 
screen indicated by the information received from the 
reproduction controlling unit, and setting a condition for 
extracting navigation information in the extracting unit. 

With such a construction, it is possible to extract 
navigation information suitable for a display screen type 
to achieve a user interface. 

In the above broadcast reception apparatus, the 
display screens may include a wide screen with aspect 
ratio 16:9, a normal screen with aspect ratio 4:3, and a 
small-scale LCD (Liquid Crystal Display), navigation 
information con-esponding to the wide screen includes 
display position information which indicates a position 
for displaying graphics data, the position being a right- 
hand side and a left-hand side blank areas generated 
when a normal-size image is displayed on the wide 
screen, navigation information corresponding to the 
normal screen includes display position information 
which indicates a position for displaying graphics data, 
the position being a top and bottom blank areas gener- 
ated when a wide-size image is displayed on the normal 
screen, and navigation information corresponding to the 
small-scale LCD includes display position information 
which indicates a position for displaying graphics data, 
the position being almost a whole display area, the 
extract controlling unit includes: a size receiving unit for 
receiving image size information specifying either of a 
wide size and a normal size concerning an image of the 
video data; and a display instructing unit for instructing 
the reproduction controlling unit to display the graphics 
data on a display screen at a position indicated by the 
display position information in accordance with the infor- 
mation indicating one out of the display screens 
received from the reproduction controlling unit and in 
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accordance with the image size information received by 
the size receiving unit. 

With the above construction, it is possible to 
achieve a user interface suitable for the display unit 

5 since: graphics data is displayed on a right-hand side 
and a left-hand side blank areas on the wide screen if 
the image has the normal size; graphics data is dis- 
played on a top and bottom blank areas on the normal 
screen if the image has the wide size; and graphics data 

10 is displayed on almost a whole display area of the small- 
scale LCD, 

The above broadcast reception apparatus may fur- 
ther comprise: operation receiving unit for receiving a 
user operation; a modem connected to a public net- 

15 work; and apparatus information storage unit for storing 
a telephone number of a connection destination to 
which the modem is connected, where the extract con- 
trolling unit includes: an authority checking unit for read- 
ing the telephone number, connecting to the connection 

20 destination by the modem, and checking whether a pay 
broadcast program is to be viewed when the extracting 
unit extracts video data of the pay broadcast program 
and the operation receiving unit receives a user opera- 
tion indicating that the user selects the pay broadcast 

25 program; a first extract condition setting unit, when the 
authority checking unit receives a confirmation that the 
pay broadcast program is to be viewed, for setting a 
condition in the extracting unit for extracting navigation 
information included in a navigation information 

so sequence related to the confirmation that the pay broad- 
cast program is to be viewed; and a second extract con- 
dition setting unit, when the authority checking unit 
receives an answer that the pay broadcast program is 
not to be viewed, for setting a condition in the extracting 

35 unit for extracting navigation information included in a 
navigation information sequence related to the answer 
that the pay broadcast program is not to be viewed. 

With such a construction, it is possible to provide a 
user interface which appropriately shows the user that 

40 the selected program is a pay broadcast program and 
whether the user is authorized to view the program. 

In the above broadcast reception apparatus, the 
authority checking unit may receive information of a per- 
mitted audience time period together with the confirma- 

45 tion that the pay broadcast program is to be viewed, the 
extract controlling unit includes: a timer unit for activat- 
ing the second extract condition setting unit when the 
permitted audience time period has expired. 

With such a construction, it is possible to inform the 

50 user of unavailability of the program when the permitted 
audience time period has expired. 

Jhe above object is also achieved by a broadcast 
reception apparatus for receiving broadcast data as a 
transport stream, where the transport stream includes 

55 video data and a plurality of pieces of navigation infor- 
mation which includes graphics data to be combined 
with the video data for display, the broadcast reception 
apparatus comprising: operation receiving unit for 
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receiving a user operation; extracting unit for extracting 
the video data and navigation information from tlie 
transport stream; extract controlling unit for controlling 
the extracting unit so that the extracting unit extracts two 
or more pieces of navigation information out of the plu- 5 
rality of pieces of navigation information in accordance 
with the user operation received by the operation receiv- 
ing unit; navigation information storage unit for storing 
the two or more pieces of navigation information 
extracted by the extracting unit; and reproduction con- 10 
trolling unit for combining graphics data included in the 
two or more navigation information stored in the naviga- 
tion information storage unit with the video data 
extracted by the extracting unit and displaying a com- 
posite image which is a result of this combination. 15 

With the above construction, it is possible to extract 
as many pieces of navigation information as necessary 
from a plurality of pieces of navigation information in 
accordance with the user operation and combine the 
graphics data of the extracted pieces of navigation infor- 20 
mation with the video data to achieve a user interface. In 
addition, the capacity of a storage unit storing the navi- 
gation information may be reduced since only neces- 
sary pieces of navigation information are stored in the 
storage unit. 25 

In the above broadcast reception apparatus, the 
user operation received by the operation receiving unit 
may be a user attribute, and each of the plurality of 
pieces of navigation information may include graphics 
data corresponding to a user attribute. 30 

With such a construction, it is possible for the user 
to selectably use navigation information which is suita- 
ble for the user. 

The above broadcast reception apparatus may fur- 
ther comprise: a modem connected to a public network; 35 
apparatus information storage unit for storing a tele- 
phone number of a connection destination to which the 
modem is connected; and transmitting unit for transmit- 
ting data to the connection destination by the modem, 
the data corresponding to a response by a user to the 40 
graphics data displayed by the reproduction controlling 
unit. 

With the above construction, it is possible to per- 
form a research by unit of questionnaires using display 
images as a user interface. 45 

The above object is also achieved by a record 
medium to be used for a broadcast reception apparatus, 
where the broadcast reception apparatus receives 
broadcast data as a transport stream, the transport 
stream includes video data and a plurality of navigation so 
information sequences, each of the plurality of naviga- 
tion information sequences includes navigation informa- 
tion which includes graphics data to be combined with 
the video data for display the broadcast reception appa- 
ratus comprises: an extracting unit for extracting the 55 
video data and navigation information from the transport 
stream; and a navigation information storage unit for 
storing the navigation information extracted by the 



extracting unit, a program is recorded in the record 
medium, the program includes: an extract controlling 
step for controlling the extracting unit so that the extract- 
ing unit extracts navigation information from one out of 
the plurality of navigation information sequences which 
is related to the broadcast reception apparatus; and a 
reproduction controlling step for combining graphics 
data included in the navigation information stored in the 
navigation information storage unit with the video data 
extracted by the extracting unit and displaying a com- 
posite image which is a result of this combination. 

With the above construction, the record medium is 
used in a broadcast reception apparatus not having 
originally a function of selecting desired navigation 
information so that the broadcast reception apparatus 
can selectively use navigation information suitable for 
the apparatus to achieve a user interface. 

The above object is also achieved by a record 
medium to be used for a broadcast reception apparatus, 
where the broadcast reception apparatus receives 
broadcast data as a transport stream, where the trans- 
port stream includes video data and a plurality of pieces 
of navigation information which includes graphics data 
to be combined with the video data for display, the 
broadcast reception apparatus comprises: an extracting 
unit for extracting the video data and navigation infor- 
mation from the transport stream; and a navigation 
information storage unit for storing two or more pieces 
of navigation information extracted by the extracting 
unit, a program is recorded in the record medium, the 
program includes: a determining step for determining a 
user operation; an extract controlling unit for controlling 
the extracting unit so that the extracting unit extracts the 
two or more pieces of navigation information out of the 
plurality of pieces of navigation information in accord- 
ance with the user operation determined in the deter- 
mining step; a combining step for combining together 
two or more pieces of graphics data included in the two 
or more navigation information stored in the navigation 
information storage unit; and a combination displaying 
step for combining the graphics data confined in the 
combining step with the video data extracted by the 
extracting unit and displaying a composite image which 
is a result of this combination. 

With the above construction, it is possible for a 
broadcast reception apparatus to extract as many 
pieces of navigation information as necessary to com- 
bine their graphics data with the video data and achieve 
a user interlace by loading the above record medium 
even if the broadcast reception apparatus does not have 
this function. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG.1 is a block diagram showing the construction 
of Embodiment 1 of the present invention, a broadcast 
reception apparatus. 

FIG.2 shows the contents of the transport streams 



5 



7 



EP 0 863 669 A1 



received by the reception unit of Embodiment 1 . 

FIG.3 sfiows tine script information included in the 
navigation information of Embodiment 1 . 

FIG.4 shows a transport stream of Embodiment 1 . 

FIG.5 shows remote controllers used in Embodi- s 
ment 1 as external units. 

FIG.6 shows contents of the apparatus information 
storage unit of Embodiment 1 . 

FIG. 7 shows an image displayed on the display unit 
of Embodiment 1 . io 

FIG.8 shows an Image displayed on the display unit 
of Embodiment 1. 

FIG.9 shows an Image displayed on the display unit 
of Embodiment 1 . 

FIG. 10 shows an image displayed on the display is 
unit of Embodiment 1 . 

FIG. 11 shows an image displayed on the display 
unit of Embodiment 1. 

FIG.12 is a flowchart showing the operation of 
Embodiment 1. 20 

FIG. 13 is a block diagram showing the construction 
of Embodiment 2 of the present invention, a broadcast 
reception apparatus. 

FIG.1 4 shows the contents of the transport streams 
received by the reception unit of Embodiment 2. ss 

FIG.1 5 shows the script information included in the 
navigation information of Embodiment 2. 

FIG. 16 shows a transport stream of Embodiment 2. 

FIG. 17 shows contents of the apparatus informa- 
tion storage unit of Embodiment 2. 30 

FIG. 18 shows an image displayed on the display 
unit of Embodiment 2. 

FIG.1 9 shows an image displayed on the display 
unit of Embodiment 2. 

FIG.20 shows an Image displayed on the display 3S 
unit of Embodiment 2. 

FIG.21 shows an image displayed on the display 
unit of Embodiment 2. 

FiG.22 shows an image displayed on the display 
unit of Embodiment 2. 40 

FIG.23 is a flowchart showing the operation of 
Embodiment 2. 

FIG.24 is a block diagram showing the construction 
of Embodiment 3 of the present invention, a broadcast 
reception apparatus. 45 

FIG.25 shows the contents of the transport streams 
received by the reception unit of Embodiment 3. 

FIG.26 shows the script information included in the 
navigation information of Embodiment 3. 

FIG.27 shows contents of the apparatus informa- so 
tion storage unit of Embodiment 3. 

FIG.28 shows an image displayed on the display 
unit of Embodiment 3. 

FIG.29 shows an image displayed on the display 
unit of Embodiment 3. 55 

FIG.30 shows an image displayed on the display 
unit of Embodiment 3. 

FIG.31 is a flowchart showing the operation of 



Embodiment 3. 

FIG.32 is a block diagram showing the construction 
of Embodiment 4 of the present invention, a broadcast 
reception apparatus. 

FIG.33 shows the contents of the transport streams 
received by the reception unit of Embodiment 4. 

FIG.34 shows the contents of the graphics data 
included in the navigation information shown in FIG.33. 

FIG.35 shows the script information included in the 
navigation information shown In FIG.33. 

FIG.36 shows an image displayed on the display 
unit of Embodiment 4. 

FIG.37 shows an image displayed on the display 
unit of Embodiment 4. 

FIG.38 shows an image displayed on the display 
unit of Embodiment 4. 

FIG.39 is a flowchart showing the operation of 
Embodiment 4. 

FIG.40 shows navigation information table NVT 
(0,2) which has the same contents as navigation infor- 
mation NVT (0,2) of Embodiment 1 . 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

Preferred embodiments of the present invention, a 
broadcast reception apparatus, are described below 
with reference to drawings. 

(Embodiment 1 > 

FIG.1 is a block diagram showing the construction 
of Embodiment 1 of the present invention, a broadcast 
reception apparatus. 

A broadcast reception apparatus 101 is composed 
of a reception unit 102, a TS (Transport Stream) 
decoder unit 1 03, an AV decoder unit 1 04, an apparatus 
information storage unit 105, a navigation information 
storage unit 106, a signal reception unit 107, a reception 
control unit 108, a reproduction control unit 109, a dis- 
play unit 110, and an audio output unit 111. With the 
above construction, the broadcast reception apparatus 
101 selects a program (event) from a transport stream 
by using navigation information for each user, the trans- 
port stream being broadcast data transmitted from a 
broadcast apparatus (not shown in the drawings). 

Note that the transport stream is broadcast data 
multiplied by an MPEG (Moving Picture Experts 
Group2) system. The transport stream includes video 
streams and navigation information as described later. 
The navigation information includes graphics data 
which is superimposed on the image of broadcast data 
to interface with the user. The navigation information 
also includes script information for securing an interac- 
tive communication with the user. 

The TS decoder unit 103 includes a filter condition 
storing unit 112. The signal reception unit 107 receives 
user operation signals from remote controllers 1 13 and 
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1 1 4 being external apparatuses. 

The reception unit 102 receives transport streams 
specified by tine reception control unit 108 and outputs 
the received transport streams to the TS decoder unit 
103. 

FIQ.2 shows the contents of the transport streams 
received by the reception unit 102. 

A transport stream 201 includes a video stream 202 
and navigation information sequences 203 and 204. 
The video stream 202 is video data of a world tour 
guide; the navigation information sequences 203 and 
204 are used as user interfaces during reproduction of 
the video stream 202. The video stream 202 and either 
of the navigation information sequences 203 and 204 
make up an event. 

The navigation information sequence 203 is a user 
interface for children and includes quizzes which are 
superimposed on the reproduction image of the video 
stream 202. The navigation information sequence 204 
is a user interface for adults and includes detailed infor- 
mation which is superimposed on the reproduction 
image of the video stream 202. The navigation informa- 
tion sequences 203 and 204 includes a variety of con- 
tents corresponding to scenes in the reproduction 
image. 

The navigation information sequence 203 has three 
versions: NVT (0,0), NVT (0,1), and NVT (0,2); the nav- 
igation information sequence 204 has five versions: 
NVT (1,0), NVT (1,1), NVT (1,2), NVT (1,3), and NVT 
(1.4). 

Each piece of navigation information includes 
graphics data 205, display information 206, time infor- 
mation 207, and script information 208. The graphics 
data 205 is superimposed on the reproduction Image; 
display information 206 specifies a display position and 
a display frame of the graphics data 205; time informa- 
tion 207 shows a display effective time for each version; 
and script information 208 shows an output operation 
and a display operation to be performed according to a 
user operation. For example, NVT (0,0) of the naviga- 
tion information sequence 203 has a display effective 
time for a period between time t1 and time t2. 

FIG.3 shows a variety of pieces of script information 
208 included in respective pieces of navigation informa- 
tion which are further included in either of navigation 
information sequences 203 and 204. For example, NVT 
(0,1) of the navigation information sequence 203 speci- 
fies that a composite tone of a chime indicating "correct" 
is output when the user depresses the ENTER button 
while "2. EGYPT' is focused on the display screen. 

NVT (1,N) of the navigation information sequence 
204 specifies that "detailed information" is displayed on 
the screen when variable Y is "1 ." The detailed informa- 
tion is graphics data as described above. Note that the 
script for a display operation is omitted In NVT (0,N). 

FIG.4 shows the transport stream 201 transmitted 
from a broadcast station. As shown in the drawing, each 
of the video stream 202 and the navigation information 



sequences 203 and 204 has its identification informa- 
tion so that the TS decoder unit 103 can separate them 
from the transport stream 201 . 

The video stream 202 has an MPEG-2 compliant 

5 identifier PID. The navigation information sequences 
203 and 204 have an MPEG-2 compliant identifier PID, 
a table identification extension (table_id_extension), 
and a version number (version_no). 

The transport stream 201 also includes multiplexed 

10 PCRs (Program Clock Reference) 401 used for manag- 
ing the reproduction time. Each version of the naviga- 
tion information sequences 203 and 204 Is repeatedly 
transmitted during the specified display effective time. 
TTie transport stream 201 includes other mulli- 

15 plexed system information such as PMT (Program Map 
Table) stipulated in MPEG2 or DVB (Digital Video 
Broadcasting). The system information Is not described 
in the present document since it is not relevant to the 
present invention. Techniques for multiplexing the trans- 

20 port stream are described in "Sogo Maruchimedia Sen- 
sho MPEG (Selected Book on Multimedia: MPEG), 
edited by the Television Society, Ohm Inc., 1994. 

The TS decoder unit 103 includes the filter condi- 
tion storing unit 1 12 for storing a filter condition set by 

25 the reception control unit 1 08. The TS decoder unit 1 03, 
according to the set filter condition, separates a video 
stream, navigation information, and PCRs from the 
transport stream output from the reception unit 1 02. The 
TS decoder unit 103 outputs the separated video 

30 stream to the AV decoder unit 1 04, writes the separated 
navigation information Into the navigation information 
storage unit 106. and outputs the separated PCRs to 
the AV decoder unit 104. 

TTie filter condition storing unit 1 1 2 stores a plurality 

35 of filter conditions. The TS decoder unit 103 performs a 
plurality of separation processes in parallel based on 
the plurality of filter conditions. 

TTie TS decoder unit 103 separates the video 
stream from the transport stream and outputs it to the 

40 AV decoder unit 1 04 when the reception control unit 1 08 
stores PID "0x0096" in the filter condition storing unit 
112 as a filter condition. 

The TS decoder unit 103 fetches NVT (0,N), which 
corresponds to one of the versions cun'ently transmitted 

45 by repetition, and stores it in the navigation information 
storage unit 106 when the reception control unit 108 
stores PID "0x0092" and tableJd_extension "0x0000" 
in the filter condition storing unit 112. The TS decoder 
unit 103 tiien fetches NVT (0,n+1) and stores it in the 

50 navigation information storage unit 1 06 when the recep- 
tion control unit 108 stores version_no "OxO(n+1)" in the 
filter condition storing unit 112 as a filter condition, with 
the PID and tableJd_extension kept unchanged. 
The TS decoder unit 103 fetches NVT (1 ,N), which 

55 Is cun'ently transmitted repeatedly and stores it in the 
navigation information storage unit 106 when tine recep- 
tion control unit 108 stores PID "0x0093" and 
table_id_extension "0x0001" in the filter condition stor- 
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ing unit 1 12. The TS decoder unit 103 then fetches NVT 
(1,n+1) and stores it in the navigation information stor- 
age unit 106 when the reception control unit 108 stores 
version_no "OxO(n+1)" in the filter condition storing unit 

112 as a filter condition. 

The AV decoder unit 104 includes a clock unit 
which Is not shown in the drawings. The AV decoder unit 
1 04, in synchronization with the clock unit and in compli- 
ance with MPEG2, decodes the video stream 202 out- 
put from the TS decoder unit 103 and outputs the 
decoded video stream to the reproduction control unit 
109. The clock unit is set to a correct standard time 
based on the PCRs output from the TS decoder unit 1 03 
and counts a standard time to synchronize with the 
decoding of the video stream 202. 

The apparatus information storage unit 105 stores 
relationships between operations by the user on an 
external unit and the navigation information sequences 
203 and 204, the external unit being used to transmit 
signals to the signal reception unit 107 of the broadcast 
reception apparatus 101. 

FIG.5 shows appearances of remote controllers 

113 and 114, samples of the external unit. The remote 
controller 113 is intended for use by adults, with Chi- 
nese characters written on the buttons. The remote con- 
troller 114 is intended for use by children and the 
buttons are written with Hiragana (a Japanese charac- 
ter) so that children can read. Both remote controllers 
113 and 114 have a power key 503, a screen display 
key 504, a "t" key 505, a "I" key 506, a key 507, a 
"<-" key 508, an enter key 509. 

FIG.6 shows relationships between the remote con- 
trollers 113 and 114 and the navigation information 
sequences 203 and 204. 

The drawing shows that the navigation information 
sequence 204 is selectively separated from the trans- 
port stream when the remote controller 1 13 is operated 
by the user; the navigation information sequence 203 is 
selectively separated from the transport stream when 
the remote controller 1 14 is operated. 

The signal reception unit 107 receives a user oper- 
ation signal from either of the remote controllers 113 
and 1 1 4 and outputs the received signal to the reception 
control unit 108. For example, the signal reception unit 
107 receives a signal specifying an event selected by 
the user from events included in the transport stream 
transmitted from a broadcast station, then outputs the 
received signal to the reception control unit 108. In 
doing this, the signal reception unit 107 also sends an 
identification number of remote controller 1 13 or 1 14 to 
the reception control unit 108 together with the signal 
specifying the event. The signal reception unit 107 
receives a "t" signal, a "i" signal, and an enter signal, 
which are described later, and outputs the received sig- 
nals to the reception control unit 108. When the user 
presses the "t" key 505, "i" key 506, or enter key 509, 
the remote controller 1 13 transmits a signal correspond- 
ing to the pressed key to the signal reception unit 107. 



The "t" key 505 and the "i" key 506 are used to change 
the number in focus on the display unit 1 10 upward and 
downward respectively The enter key 509 is used to 
determine to enter a number or a button in focus. 

5 On receiving an event selection signal input by the 
user and transferred from the signal reception unit 107, 
the reception control unit 108 stores PID "0x0096" in the 
filter condition storing unit 1 12 as a filter condition. On 
receiving an identification number of a remote controller 

10 from the signal reception unit 1 07, the reception control 
unit 1 08 refers to the apparatus information storage unit 
105 for the relationships between the remote controller 
and the navigation information sequences, and stores a 
of the navigation information in the filter condition stor- 

15 Ing unit 112. 

When the user uses the remote controller 1 13, the 
reception control unit 108 receives identification number 
"1" from the signal reception unit 107, reads 
table_id_extension "0x0001" from the apparatus infor- 

20 mation storage unit 105, stores PID "0x0093" and 
table_id_extension "0x0001" in the filter condition stor- 
ing unit 1 12 as a filter condition. Note that the reception 
control unit 108 detects the PID value from 
table_id_extension by referring to system information 

25 which has not been described. 

When the navigation information storage unit 106 
stores NVT (1,0), for example, the reception control unit 
1 08 reads the time information 207 corresponding to the 
NVT (1 ,0), refers to the clock unit in the AV decoder unit 

30 1 04, stores the next version_no "0x01 " of the navigation 
information sequence 204 in the filter condition storing 
unit 112, with the PID and table_id_extension 
unchanged, when the display effective time comes to an 
end, reaching time 12. 

35 On receiving the enter signal from the signal recep- 
tion unit 107 while the navigation information storage 
unit 106 stores NVT (1,0), the reception control unit 108 
sets variable Y to "1." 

The reception control unit 108 sends a display 

40 Instruction to the reproduction control unit 109 accord- 
ing to the display operation specified in the script infor- 
mation as the NVT changes to (1,1), (1,2), (1.3), or 
(1.4). 

The reception control unit 108 reads the graphics 
45 data 205 and the display information 206 from the navi- 
gation information storage unit 106 and sends them to 
the reproduction control unit 109. 

On receiving the enter signal from the signal recep- 
tion unit 107 while the navigation information storage 
50 unit 106 stores NVT (0,1) or (0,2), the reception control 
unit 108 sets variable X to "-1" according to the script 
information If the number in focus set by the reproduc- 
tion control unit 109 is "1" (representing U.K.) or "3" 
(representing Japan); the reception control unit 1 08 sets 
55 variable X to "1" if the number in focus is "2" (represent- 
ing Egypt), 

The reception control unit 108 instructs the repro- 
duction control unit 109 to output a buzzer for variable X 



13 EP 0 863 669 A1 14 



"-1" and a chime for variable x "1," then sets variable X 
to "0." 

The reproduction control unit 109, according to an 
instruction from the reception control unit 108, gener- 
ates an image signal by combining image data decoded s 
by the AV decoder unit 104 with graphics data output 
from the reception control unit 108, and outputs the gen- 
erated image signal to the display unit 110. The repro- 
duction control unit 109 also generates composite tone 
based on an interpretation of the script sent from the io 
reception control unit 108 and outputs the composite 
tone to the audio output unit 111. Simultaneously, 
graphics data is superimposed on the image data at a 
display position corresponding to a position in a display 
frame of the display screen. is 

The display unit 110, achieved by a CRT an LCD 
(Liquid Crystal Display) or the like, displays images 
received from the reproduction control unit 109. 

The audio output unit 111, achieved by a speaker or 
the like, outputs sounds received from the reproduction so 
control unit 109. 

The following is a description of specific display 
operations on the display unit 110. The TS decoder unit 
103 separates the video stream 202 from the transport 
stream and outputs it to the AV decoder unit 1 04 when 25 
the user selects an event in the transport stream 201 
using the remote controller 1 1 3 during a period between 
time t1 and time t2. On receiving the graphics data and 
the display information, which are user interfaces for 
adults, corresponding to NVT (1 ,0) from the reception so 
control unit 1 08, the reproduction control unit 1 09 super- 
imposes the graphics data on the image data decoded 
by the AV decoder unit 1 04 at a display position in a dis- 
play frame specified by the display information, then 
outputs the composite image to the display unit 110. 35 
FIG.7 shows an image displayed on the display unit 110 
as a result of the above operation. The reproduction 
control unit 1 09 specifies an area on the display unit 1 1 0 
displaying graphics data "detailed Information" as a 
default area in focus. When the user presses the enter 40 
key 509 on the remote controller 113 under the condi- 
tion, the TS decoder unit 103 fetches NVT (1,1) at time 
t2 and stores it in the navigation information storage unit 
106. FIG.8 shows an image displayed on the display 
unit 1 1 0 as a result of this operation. 45 

FIG.9 shows an image displayed on the display unit 
110 when the user selects an event using the remote 
controller 114 during the period between time t1 and 
time t2. When the user presses the enter key 509 under 
the condition, the display unit 110 shows displays an so 
image as shown in FiG.10. The reproduction control 
unit 109 specifies number "1" for U.K. as a default area 
in focus. When the user presses the "i' key 506 once 
on the remote controller 114, the reproduction control 
unit 1 09 receives the "I" signal from the reception con- 55 
trol unit 108 and slides the state in focus to number "2" 
for Egypt. The reproduction control unit 109 also 
receives an instruction to output composite tone of a 



chime and insti-ucts the audio output unit 1 1 1 to output 
the composite tone of chime. 

The displayed image changes to the one shown in 
FIG. 1 1 after time t5. The default in-focus area is number 
"1" for China. When the user presses the enter key on 
the remote controller 1 14, the audio output unit 1 1 1 out- 
puts composite tone of a buzzer. 

Now, the operation of the present embodiment is 
described with reference to the flowchart shown in 
FIG. 12. 

The TS decoder unit 103 separates video stream 
202 from the transport stream, fetches navigation infor- 
mation corresponding to an operation by the user to 
select an event on the remote controller, and stores the 
fetched navigation information in the navigation infor- 
mation storage unit 106 (step S1202). The reception 
control unit 108 judges whether an operation signal has 
been entered by the user (S1204). If no operation signal 
has been entered, control goes to SI 21 2. If an opera- 
tion signal has been entered, it is judged in step SI 206 
whether the input operation signal is one of certain sig- 
nals such as the enter signal, "t" signal, and "i" signal 
respectively corresponding to the enter key 509, "t" key 
505, and"!" key 506 and whetiier the remote controller 
identification number of the operation signal is different 
from tiiat of the preceding signal. When the identifica- 
tion number Is different, an event (navigation informa- 
tion) different from the current one is fetched (SI 208). 
When the identification number is not different, variable 
X or Y is set to a certain value according to the script 
information in the navigation information reflecting the 
input operation (SI 210), then conti'ol moves to step 
81212. 

In step SI 21 2, the reception control unit 108 deter- 
mines the data to be displayed based on the value set 
as variable X or Y: the reception control unit 108 deter- 
mines that the detailed information of the navigation 
information sequence 204 should be displayed by refer- 
ring to the display operation in the script information 
when variable Y is "1"; the reception control unit 108 
determines that the graphics data of the navigation 
information sequence 203 should be displayed when 
variable X is "0." 

The reproduction control unit 109 combines the 
image data of the video stream with the graphics data in 
the navigation information (SI 21 4). The display unit 1 1 0 
displays tiie composite image. At the same time, the 
audio output unit 1 1 1 outputs certain composite tone 
when variable X is "1" or "-1" (S1216). The control then 
returns to step SI 202. 

As apparent from tiie above description, the 
present embodiment enables the broadcast reception 
apparatus to select a navigation information sequence 
corresponding to an external unit. This indicates that as 
many user interfaces as there are external units can be 
provided using navigation information selectively 
related to the external units used by users. 

Note that in tiie present embodiment, ttie naviga- 
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tion information is selected according to the type of the 
remote controller the user operates. However, the navi- 
gation information may be selected by identifying the 
user from an input voice. 

A button for changing the navigation information s 
received by the broadcast reception apparatus may be 
formed on the remote controller. 

In the present embodiment, composite tone is used 
to indicate whether the answer to a quiz is correct or 
incorrect. Howei/er, a message may be displayed on the io 
screen for the same purpose. 

(Embodiment 2) 

FIG. 1 3 is a block diagram showing the construction i5 
of Embodiment 2 of the present invention, a broadcast 
reception apparatus. 

A broadcast reception apparatus 1301 is composed 
of a reception unit 102, a TS decoder unit 103, an AV 
decoder unit 1 04, an apparatus information storage unit 20 
1 302, a navigation Information storage unit 1 06, a signal 
reception unit 107, a reproduction control unit 1303, a 
reception control unit 1304, a display unit 1305, and an 
audio output unit 111. With the above construction, the 
broadcast reception apparatus 1301 selects an event ss 
from a transport stream by using navigation information 
for each user, the transport stream being broadcast 
data transmitted from a broadcast apparatus (not 
shown in the drawings). The TS decoder unit 103 
includes a filter condition storing unit 112. The signal so 
reception unit 107 receives user operation signals from 
a remote controller 1 13 being an external apparatus. 

The broadcast reception apparatus 1301 is com- 
posed of almost the same components as the broadcast 
reception apparatus 1 01 of Embodiment 1 . Accordingly, 35 
the following description mainly deals with features 
unique to the present embodiment, with the same refer- 
ence signs attached to the same components. 

FIG. 1 4 shows the contents of the transport streams 
received by the reception unit 1 02. 40 

A transport stream 1401 includes a video stream 
1402 being video data of a movie "Lost World" and also 
includes three kinds of navigation information, NVT (0), 
(1), and (2). The video stream 1402 and either of the 
NVT (1 ) and (2) make up an event. 45 

Each piece of navigation information includes 
graphics data 1403, display information 1404, and script 
information 1405. The display information 1404 speci- 
fies a display position of the graphics data. NVTs (0), 
(1), and (2) are respectively for display units 1305 with so 
the wide screen with aspect ratio "16:9," the normal 
screen with aspect ratio "4:3," and small-scale LCD 
screen. 

FIG. 15 shows a variety of pieces of script informa- 
tion corresponding to the NVTs (0), (1), and (2). The ss 
script information specifies a combination operation and 
a display operation of the graphics data to be displayed 
on the display unit 1305. For example, NVT (0) specifies 



that a composite image of graphics data 1403 being 
superimposed on the image data should be displayed 
over a time period between time t1 and time t5 if the 
aspect ratio of the display unit 1 305 is 4:3 (normal), and 
that a composite image of translucent graphics data 
1403 being superimposed on the Image data by "alpha 
blending" should be displayed for one second out of 10 
seconds during a period between time t1 and time t5 if 
the aspect ratio of the display unit 1 305 is 16:9 (wide). 

When a normal-size image is displayed on a wide- 
size TV, the right-hand and left-hand edges of the 
screen (letter boxes) do not display image. Display infor- 
mation 1404 of NVT (0) specifies display positions of 
the letter boxes, indicating the areas on the screen 
occupied by the letter boxes. Display information 1404 
of NVT (1) specifies display positions of top and bottom 
letter boxes which are generated when a wide-size 
image is displayed on a normal-size TV. Display infor- 
mation 1404 of NVT (2) specifies almost whole screen 
of the small-scale LCD screen as a display position 
since the small-scale LCD screen has such a low reso- 
lution as users may feel difficulty in reading small letters. 

FIG.16 shows the transport stream 1401 being 
transmitted from a broadcast station. The navigation 
information NVTs (0), (1), and (2) are transmitted 
repeatedly during the period between time t1 and time 
15. 

The video stream of the movie "Lost World" has 
PID "0x0095" as the identification information. 

NVT (0) has PID "0x0092" and 
table_id_extenslon "0x0000," NVT (1) has PID 
"0x0093" and table_id_extension "0x0001," NVT (2) 
has PID "0x0094" and tableJd_extension "0x0002" as 
respective identification information. 

FIG. 17 shows relationships between screen types 
of the display unit 1305 and the navigation information. 
The wide screen is related to table_id_Kctension 
"0x0000" of NVT (0). The normal screen is related to 
table_id_extension "0x0001" of NVT (1). The small- 
scale LCD screen is related to table_id_extension 
"0x0002" of NVT (2). 

The reproduction control unit 1303 notifies the 
reception control unit 1304 of the screen type (wide, 
normal, or small-scale LCD) of the display unit 1305. 

The reproduction control unit 1303 also notifies the 
reception control unit 1304 of the image size (wide or 
normal) of the video stream 1402 having been decoded 
by the AV decoder unit 104. 

On receiving graphics data, display information, 
composite operation information (indicating either of 
superimposing or alpha blending), and display time 
information from the reception control unit 1304, the 
reproduction control unit 1303 superinposes the graph- 
ics data on or combines the graphics data with the 
image data of the video stream having been decoded by 
the AV decoder unit 104 according to the display infor- 
mation and displays the composite image on the display 
unit 1305 as specified by the display time information 
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referring to the clock unit of the AV decoder unit 104. 

On receiving tlie screen type (wide, normal, or 
small-scale LCD) of the display unit 1305 from the 
reproduction control unit 1303, the reception control unit 
1 304 reads out from the apparatus information storage s 
unit 1302 the table identification extension of the navi- 
gation information corresponding to the received screen 
type, refers to the system information which is not 
shown in the drawings, and stores the filter condition of 
this navigation information in the filter condition storing io 
unit 1 12 of the TS decoder unit 103. 

On receiving the aspect ratio of the image of the 
video stream 1402 having been decoded by the AV 
decoder unit 104 from the reproduction control unit 
1303, the reception control unit 1304 reads the naviga- 15 
tion information from the navigation information storage 
unit 106. The reception control unit 1304 then sends 
graphics data, display information, composite operation 
information (indicating either of superimposing or alpha 
blending), and display time information to the reproduc- 20 
tion control unit 1303. 

The display unit 1305 is achieved by a normal-size, 
a wide-size, or a small-scale LCD TV. 

The following is a description of specific display 
operations on the display unit 1 305. ss 

FIG.18 shows a screen displayed on the display 
unit 1305 during a period between time t1 and time t2 if 
the display unit 1305 has the wide screen. Here, the 
navigation information storage unit 106 stores NVT (0). 
A letter box 1801 of the wide screen displays graphics 30 
data 1403 specified by NVT (0). FIG. 19 shows a screen 
displayed on the display unit 1305 during a period 
between time t2 and time t5 if wide-size images are 
transmitted, as indicated by arrow T in FIG. 14. Note that 
the video as the main image changes with time and that as 
the portions covered with slashes in the drawing repre- 
sent translucent graphics data. The graphics data is dis- 
played for one second out of 10 seconds during a time 
period between time t2 and time t5. 

The translucent graphics data prevents the image 40 
under the graphics data from being entirely covered. 
Also, the graphics data is displayed intermittently, which 
enables to display useful information without disturbing 
the user in his/her watching the video. 

The navigation information storage unit 106 stores 45 
NVT (1) when the display unit 1305 has a normal-size 
screen. FIG.20 shows a screen displayed on the display 
unit 1305 of normal size during the period between time 
t1 and time t2. The drawing shows that translucent 
graphics data is displayed on the image showing the so 
title of the movie "Lost World." The graphics data is dis- 
played for one second out of 10 seconds. As shown in 
FIG.21, letter boxes 2101 and 2102 appear in the top 
and bottom portions of the screen during a period 
between time t2 and time t5 if wide-size images are 55 
transmitted, as indicated by arrow T in FIG. 14. The 
graphics data is superimposed on a top letter box 2101 . 
The navigation information storage unit 106 stores 



NVT (2) when the display unit 1305 is a small-scale 
LCD. FIG.22 shows a screen displayed for three sec- 
onds on the display unit 1305 of the small-scale LCD if 
the video stream 1402 is selected after time t2. The 
graphics data covers almost the entire screen so that 
large characters are displayed since the small charac- 
ters displayed on the small-scale LCD are difficult for 
the user to read. Also, the graphics data is displayed 
only for a certain period so that it does not disturb the 
user in his/her watching the video. 

Now, the operation of the present embodiment is 
described with reference to the flowchart shown in 
FIG.23. 

The reception control unit 1304 judges whether a 
video stream has been selected by the user (S2302). 
When a video stream has been selected, a filter condi- 
tion corresponding to the selected video stream is 
stored in the filter condition storing unit 1 12 of the TS 
decoder unit 103. Then, on receiving information from 
the reproduction control unit 1303, the reception control 
unit 1304 judges whether the screen type of display unit 
1305 is "wide" (S2304). When the screen type is not 
"wide," the reception control unit 1304 judges whether 
the screen type of display unit 1 305 is "normal" (S2306). 

When it is judged that the screen type is "wide" in 
step S2304, the reception control unit 1304 sets a filter 
condition to fetch NVT (0) (S2308). When it is judged 
that the screen type is "normal" in step S2306, the 
reception control unit 1 304 sets a filter condition to fetch 
NVT{1) (S2310). When it is judged that the screen type 
is "normal" in step S2306, the reception control unit 
1304 sets a filter condition to fetch NVT (2) recognizing 
the screen type as small-scale LCD (S2312). 

After having fetched NVT (0), the reception control 
unit 1304 judges whether the aspect ratio of the 
decoded image is 4:3 (normal size) (S2314). When hav- 
ing judged that the aspect ratio is 4:3, the reception con- 
trol unit 1304 instructs the reproduction control unit 
1303 to superimpose the graphics data on image data 
and sends the graphics data and display information to 
the reproduction control unit 1303 (S2316). The recep- 
tion control unit 1304 then instructs the reproduction 
control unit 1303 to display the graphics data through 
the whole time (S2318), and returns to step S2302. 

When having judged that the aspect ratio is not 4:3 
in step S2324, the reception control unit 1304 instructs 
the reproduction control unit 1303 to combine the 
graphics data with the image data by alpha blending, 
and sends the graphics data and display information to 
the reproduction control unit 1303 (S2320). The recep- 
tion control unit 1304 then instructs the reproduction 
control unit 1303 to display the graphics data for one 
second out of 10 seconds (S2322), and returns to step 
S2302. 

After having fetched NVT (1), the reception control 
unit 1304 judges whether the aspect ratio of the 
decoded image is 4:3 (S2324). When having judged 
that the aspect ratio is 4:3, the reception control unit 
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1304 executes steps S2320 and 2322 to return to step 
2302. When having judged that the aspect ratio is not 
4:3, the reception control unit 1304 executes steps 
S2316 and 2318 to return to step 2302. 

After having fetched NVT (2), the reception control s 
unit 1304 judges whether the aspect ratio of the 
decoded image is 4:3 {S2324). When having judged 
that the aspect ratio is 4:3, the reception control unit 
1304 instructs the reproduction control unit 1303 to 
combine the graphics data with the image data by alpha io 
blending, and sends the graphics data and display infor- 
mation to the reproduction control unit 1303 (S2326). 
The rec^tion control unit 1304 then instructs the repro- 
duction contrd unit 1303 to display the graphics data for 
three seconds (S2328), and returns to step S2302. w 

As described above, it is possible for the broadcast 
reception apparatus of the present embodiment to 
select navigation information in accordance with the 
screen types of the display unit 1305 to achieve user 
interfaces that display graphics data without disturbing so 
the user in watching video Images. 

In the present embodiment, the graphics data is 
displayed on the display unit 1305 for a certain period of 
time. However, the graphics data may be displayed 
when the user presses the screen display key 504 on ss 
the remote controller 113, 

Also, the graphics data may be presented by scroll- 
ing display as in text broadcasting. 

Further, the images may be displayed after being 
compressed so that the user can watch the graphics so 
data without difficulty (e.g., the video data is com- 
pressed in the vertical direction so that the graphics 
data is displayed on top and bottom blank portions of 
the screen which are generated by the compression). 

(Embodiment 3> 

FIG.24 is a block diagram showing the construction 
of Embodiment 3 of the present invention, a broadcast 
reception apparatus. 4o 

A broadcast reception apparatus 2401 is composed 
of a reception unit 102, a TS decoder unit 103, an AV 
decoder unit 104, an apparatus information storage unit 
2402, a navigation information storage unit 106, a signal 
reception unit 107, a reproduction control unit 109, a 4S 
reception control unit 2404, a display unit 1 10, an audio 
output unit 111, and a modem 2403. With the above 
construction, the broadcast reception apparatus 1301 
selects an event from a transport stream by using navi- 
gation information related to the status of the broadcast so 
reception apparatus 2401, the transport stream being 
transmitted from a broadcast apparatus (not shown in 
the drawings). The TS decoder unit 103 includes a filter 
condition storing unit 1 12. The signal reception unit 107 
receives user operation signals from a remote controller ss 
113 being an external apparatus. Modem 2403 Is con- 
nected by a public network 2405 to an audience author- 
ization center (not shown in the drawings) of a pay 
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program provider. 

The broadcast reception apparatus 2401 is con- 
structed almost the same as the broadcast reception 
apparatus of Embodiment 1. Therefore, the following 
description mainly deals with features unique to the 
present embodiment, with the same reference signs 
attached to the same components. 

A transport stream 2501 includes a video stream 
2502 being video data of a movie "Lost World" which is 
a pay broadcast program and also includes three navi- 
gation information sequences 2503, 2504, and 2505. 
The video stream 2502 and one out of the navigation 
information sequences 2503, 2504, and 2505 make up 
an event. 

The navigation information sequence 2503, com- 
posed of navigation information NVTs (0,0) and (0,1), is 
fetched first when the video stream of the nravie "Lost 
World," a pay broadcast program, selected. 

The navigation information sequence 2504, com- 
posed of navigation information NVTs (1,0) and (1 ,1), is 
fetched for users who have been authorized to view the 
pay broadcast program. 

The navigation information sequence 2505, com- 
posed of navigation information NVT (2,0), is fetched for 
users who have been authorized to view the pay broad- 
cast program. Each navigation information includes 
graphics data 2506, display information (not shown in 
the drawings), and script information 2507. 

FIG.26 shows a variety of pieces of script informa- 
tion included in the navigation information. The recep- 
tion control unit 2404 refers to the script information to 
give an instruction to the reproduction control unit 109, 
sets a filter condition for the TS decoder unit 1 03 to fetch 
a new piece of navigation information, and connects via 
modem 2403 to the audience authorization center by 
telephone line. 

The transport stream 2501 is not described here 
since it is similar to ones shown in FIGs.4 and 16. 

As shown in FIG.27, the apparatus information stor- 
age unit 2402 stores entry navigation information and a 
telephone number. The entry navigation information 
specifies a piece of navigation information which should 
be fetched first when the TS decoder unit 1 03 separates 
the video stream 2502 of the pay program. The tele- 
phone number is used for checking whether the user is 
authorized to view the pay program. 

The modem 2403, connected to the public network 
2405, connects the broadcast reception apparatus 2401 
to the audience authorization center when the reception 
control unit 2404 instructs so. 

The reception control unit 2404 stores identification 
information of the video stream 2502 in the filter condi- 
tion storing unit 1 12 as a filter condition when the video 
stream 2502 for the pay broadcast program movie "Lost 
World" is selected. The reception control unit 2404 then 
reads the entry navigation information from the appara- 
tus information storage unit 2402 and stores identifica- 
tion information of either of NVTs (0,0) and (0,1) in the 
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filter condition storing unit 112 as a filter condition so 
thatNVT{0,N) isfetclied. 

The reception control unit 2404 then reads out the 
script information of NVT (0,0) or (0,1) from the naviga- 
tion information storage unit 106, sets variable X to an s 
initial value "2," sends the graphics data, display infor- 
mation, and time information to the reproduction control 
unit 109 with an instruction to superimpose the graphics 
data on the image data decoded by the AV decoder unit 
104. 10 

The reception control unit 2404 sets variable X to 
"0" when having received a signal from the signal recep- 
tion unit 107 which indicates that the user has entered 
the selected pay program. 

The reception control unit 2404 then reads out the is 
telephone number of the audience authorization center 
from the apparatus information storage unit 2402. The 
reception control unit 2404 connects to the center via 
the modem 2403 and sends the identification informa- 
tion of the broadcast reception apparatus 2401 itself to so 
check whether the user is authorized to view the pay 
program. If the user has paid a fee for viewing the pro- 
gram, the audience authorization center sends an audi- 
ence authorization signal to the broadcast reception 
apparatus 2401 together with a permitted audience time ss 
period. If the user has not paid the fee, the audience 
authorization center sends an audience unauthorization 
signal. 

The reception control unit 2404 sets variable X to 
"1" when receiving the audience authorization signal, so 
and sets it to "-1" when receiving the audience unau- 
thorization signal. 

Having set variable X to "1 ," the reception control 
unit 2404 stores a filter condition in the filter condition 
storing unit 1 12 so that either of NVTs (1,0) and (1,1) is 35 
fetched. Here, NVT (1,0) is fetched during the period 
between time t1 and time t2; NVT (1,1) is fetched after 
time t2. 

Having set variable X to "-1," the reception control 
unit 2404 stores a filter condition in the filter condition 4o 
storing unit 1 12 so that NVT (2,0) is fetched. 

When the navigation information storage unit 106 
newly stores a piece of navigation information, the 
reception control unit 2404 gives instructions to the 
reproduction control unit 109 in accordance with the 45 
script information written in the new piece of navigation 
information. If the new piece of navigation information is 
NVT (1,0) and variable X is "1," the reception control 
unit 2404 sends graphics data, display information, and 
time information to the reproduction control unit 1 09 and so 
instructs it to superimpose the graphics data on the 
image data and display the composite image. If the new 
piece of navigation information is NVT (1 , 1 ) and variable 
X is "1 ," the reception control unit 2404 sends graphics 
data and display information to the reproduction control ss 
unit 109 and instructs it to superimpose the graphics 
data on the image data and display the composite 
image for two seconds. The reception control unit 2404 
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then activates a timer and continues to reproduce the 
pay program until the permitted audience time period 
has expired. When the permitted audience time period 
has expired, the reception control unit 2404 sets varia- 
ble X to "-1" and stores a filter condition in the filter con- 
dition storing unit 1 12 so that NVT (2,0) is fetched. 

When the navigation information storage unit 106 
stores NVT (2,0) and variable X is "-1," the reception 
control unit 2404 sends graphics data, display informa- 
tion, and time information to the reproduction control 
unit 109 and instructs it to superimpose the graphics 
data on the image data and display the composite 
image. 

Suppose the video stream 2502 for the movie "Lost 
World" is selected during a period between time t1 and 
time t2, the display unit 1 10 displays an image as shown 
in FIG.28. 

Further suppose the user enters the selected pay 
program to view it. Then, the image shown in FIG.29 is 
displayed on the display unit 1 10 after time t2 if the user 
has been authorized; the image shown in FIG.30 is dis- 
played on the display unit 110 after time t2 if the user 
has not been authorized due to nonpayment of the fee. 

Now, the operation of the present embodiment is 
described with reference to the flowchart shown in 
FIQ.31. 

The procedure starts as the user selects a video 
stream which is a pay program (S3102). Then, it is 
judged in step S3104 whether the user has entered the 
selected pay program indicating that the user has 
decided to view the program (S3104). When the user 
has not entered the selected pay program, the reception 
control unit 2404 stores a filter condition to fetch either 
of NVTs (0,0) and (0,1) (S3106). The reception control 
unit 2404 then instructs the reproduction control unit 
109 to combine the graphics data specified by the 
fetched navigation information with the image data and 
display the composite image (S3108). The steps S3106 
and S3108 are repeated until the user enters the 
selected pay program. 

When the user has entered the selected pay pro- 
gram, the reception control unit 2404 judges whether 
the user has been authorized to view the pay program 
by connecting to the audience authorization center via 
the modem 2403 through the public network 2405 and 
sending the identification information of the broadcast 
reception apparatus 2401 itself (S3110). Control goes 
to step S3 120 when the user has not been authorized to 
view the pay program. 

When it is judged that the user has been authorized 
to view the pay program in step S3110, the reception 
control unit 2404 stores a filter condition to fetch either 
of NVTs (1,0) and (1,1) (S3112). 

The reception control unit 2404 then instructs the 
reproduction control unit 109 to combine the graphics 
data specified by the fetched navigation information with 
the image data (S31 14). When NVT (1 ,0) is fetched, the 
reception control unit 2404 instructs the reproduction 
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control unit 109 to display the composite image for an 
effective period; when NVT (1,1) is fetched, the recep- 
tion control unit 2404 instructs the reproduction control 
unit 109 to display the composite image for a certain 
period and activates the timer (S31 16). 5 

The reproduction of the pay program Is continued 
until the permitted audience time period has expired. It 
is judged whether the permitted audience time period 
has expired in step S3118. When it is judged so, the 
reception control unit 2404 stores a filter condition to w 
fetch NVT (2,0) (S3120). In the following step S3122, 
the reception control unit 2404 instructs the reproduc- 
tion control unit 1 09 to combine the graphics data spec- 
ified by NVT (2,0) with the Image data and display the 
composite image (S31 1 4), then ends the process. w 

As described above, the broadcast reception appa- 
ratus of the present embodiment asks the audience 
authorization center if the user is authorized to view a 
pay program, selects a piece of navigation information 
in accordance with the obtained result, and informs the 20 
user whether the user can view the program or not in an 
appropriate way 

In the present embodiment, the above confirmation 
is made by checking via the public network 2405. How- 
ever, an identification card or a pre-paid card may be 25 
inserted into a reading unit of the broadcast reception 
apparatus for the same purpose, where the identifica- 
tion card indicates that the user is authorized to view the 
pay program, and the pre-paid card is given to users 
having paid the fee for viewing. 30 

(Embodiment 4) 

FIG.32 is a block diagram showing the construction 
of Embodiment 4 of the present invention, a broadcast 35 
reception apparatus. 

A broadcast reception apparatus 3201 is composed 
of a reception unit 102, a TS decoder unit 103, an AV 
decoder unit 104, an apparatus information storage unit 
3202, a navigation information storage unit 3203, a sig- 40 
nal reception unit 107, a reproduction control unit 3204, 
a reception control unit 3205, a display unit 110, an 
audio output unit 111, and a modem 3206. With the 
above construction, the broadcast reception apparatus 
1 30 1 selects an event from a transport stream by using 45 
navigation information related to the user of the broad- 
cast reception apparatus 2401, the transport stream 
being transmitted from a broadcast apparatus (not 
shown in the drawings). The TS decoder unit 103 
includes a filter condition storing unit 112. The signal so 
reception unit 107 receives user operation signals from 
a remote controller 113 being an external apparatus. 
Modem 3206 is connected by a public network 3207 to 
a broadcast station (not shown in the drawings). 

The broadcast reception apparatus 3201 is con- 55 
strucled almost the same as the broadcast reception 
apparatus of Embodiment 1. Therefore, the following 
description mainly deals with features unique to the 



present embodiment, with the same reference signs 
attached to the same components. 

FIG.33 shows the contents of the transport stream 
received by the reception unit 102. 

A transport stream 3301 includes a video stream 
3302 and seven navigation information sequences 
3303-3309, the video stream 3302 being video data 
used as background in a questionnaire program, the 
seven navigation information sequences including 
graphics data as respective questions given in the ques- 
tionnaire program. 

The navigation Information sequence 3303 is com- 
posed of navigation information, NVTs (0,0), (0,1), and 
(0,2). NVT (0,0) is fetched first when the present ques- 
tionnaire program is selected and entered. The display 
effective period for NVT (0,1) lasts from time t2 to time 
t6. The display effective period for NVT (0,2) is the time 
after time t6. 

The navigation information sequence 3304 Is com- 
posed of NVT (1). Similarly, each of the navigation infor- 
mation sequences 3305-3309 is composed of 
corresponding one of NVT (2) to NVT (6). 

NVT (0,0) is repeatedly transmitted during a period 
between time t1 and time t2. NVT (0,1) and NVTs (1)-(6) 
are repeatedly transmitted during a period between 
time t2 and time t6. NVT (0,2) is repeatedly transmitted 
after time t6. 

The graphics data specified by NVTs (0,0), (0,1), 
and (0,2) are shown in FIG.33. The graphics data spec- 
ified by NVT (0,0) is superimposed on the background 
image to urge the user to input user attributes by the 
remote controller 113. The input user attributes are 
used by the broadcast reception apparatus 3201 to 
select questions for the user. The graphics data speci- 
fied by NVT (0,1) is combined with the graphics data 
specified by any one selected from NVTs {1)-(6) and the 
composite image is further superinposed on the back- 
ground Image to be displayed. The graphics data spec- 
ified by NVT (0,2) Is superinposed on the background 
Image to inform the user that the broadcast reception 
apparatus 3201 is transmitting answers to the ques- 
tions. 

The graphics data specified by NVTs (1)- (6) are 
shown in FIG.34. NVT (1) specifies Question 1 for male. 
NVT (2) specifies Question 1 for female. NVT (3) speci- 
fies Question 2 for adults. NVT (4) specifies Question 2 
for children. NVT (5) specifies Question 3 for the Kanto 
district in Japan. NVT (6) specifies Question 3 for the 
Kansai district in Japan. Each question provides answer 
options "yes" and "no." 

Note that each piece of navigation information 
includes display information and time information as 
well as the graphics data though the former pieces of 
information are not shown in the drawing. 

NVTs (0,0), (0,1), and (0,2) Include script informa- 
tion as shown in FIG.35. A piece of script information 
specifies an NVT to be selected based on the user 
attributes input from the user by the remote controller 
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113. Another piece of script information specifies tfiat 
tfie answers to the questions are transmitted to the 
broadcast station. 

The user attributes dealt with by the script informa- 
tion of NVT (0,0) are "sex," "age," and "address." A s 
reception control unit 3205, which is later described, 
sets variable X to "1" when the user operates a certain 
key on the remote controller 1 13 to inform that the user 
is male, sets variable X to "2" when the user is female, 
sets variable Y to "3" when the user informs of his age io 
being 20 or more, sets variable Y to "4" when the user 
informs of his age being less than 20, sets variable Z to 
"5" when the user lives In the Kanto district, and sets 
variable Z to "6" when the user lives in the Kansai dis- 
trict. )5 

Variable X is used to select either of NVTs (1) and 

(2) . Similarly, variable Y Is used to select either of NVTs 

(3) and (4) and variable Z is used to select either of 
NVTs (5) and (6). 

The reception control unit 3205 sets variables A1 , 20 
A2, and A3 to "0" as the respective initial values. Varia- 
bles A1, A2, and A3 are set to "1" or "2" in accordance 
with the answers to the questions. 

The script information of NVT (0,1) specifies a dis- 
play operation of combining four pieces of graphics data 25 
specified by NVTs (0,1), PQ, (Y), and (Z) together and 
displaying the composite image. The script information 
of NVT (0,1) also specifies an input operation of setting 
variables A1, A2, and A3 to "1" or "2." 

Suppose the user enters "1 yes" as an answer to 30 
question 1, then the reception control unit 3205 sets 
variable A1 to "1 ." Similar operations are performed for 
variables A2 and A3. 

The script information of NVT (0,2) specifies that 
the values as variables X, Y, Z, A1. A2, and A3, which 35 
are set in accordance with information input from the 
user during a period between time t1 and time t6, are 
transmitted to the broadcast station. 

The apparatus information storage unit 3202 stores 
entry navigation information, the entry navigation infor- 40 
mation being identification information of NVT (0,0) 
which Is fetched first when the video stream 3302 is 
separated from the transport stream 3301 in accord- 
ance with a user operation. The apparatus information 
storage unit 3202 also stores identification information 45 
of NVTs (0,1) and (0,2) and the telephone number of the 
broadcast station. 

The navigation information storage unit 3203 stores 
the navigation information separated from the transport 
stream by the TS decoder unit 1 03. The present embod- 50 
iment differs from Embodiments 1-3 in that the naviga- 
tion information storage unit 3203 stores a plurality of 
pieces of navigation information. 

The reproduction control unit 3204, on receiving the 
graphics data, display information, and time information ss 
from the reception control unit 3205, cont)ines the 
graphics data with the image data decoded by the AV 
decoder unit 104 and displays the composite image on 



the display unit 1 10 for the display effective period. 

The reception control unit 3205 stores a filter condi- 
tion in the filter condition storing unit 112 of the TS 
decoder unit 103 so that the video stream 3302 is sepa- 
rated from the transport stream 3301 received by the 
reception unit 102 when the user selects and enters the 
questionnaire program. The reception control unit 3205 
then reads the entry navigation information from the 
apparatus information storage unit 3202 and stores a fil- 
ter condition for NVT (0,0) in the filter condition storing 
unit 112. 

When NVT (0,0) is stored in the navigation informa- 
tion storage unit 3203, the reception control unit 3205 
reads out the graphics data, display information, and 
time information as specified in NVT (0,0) and also 
reads out the script information (see FIG.35). The 
reception control unit 3205 sends the graphics data, a 
combination instruction, and a display instruction to the 
reproduction control unit 3204. 

On receiving information from the user via the sig- 
nal reception unit 107, the reception control unit 3205 
sets variables X, Y, and Z to respective values and sets 
variables A1 , A2, and A3 to "0" as their initial values. 

The reception control unit 3205 stores filter condi- 
tions in the filter condition storing unit 1 12 to fetch NVTs 
(X), (Y), (Z), and (0,1) in accordance with the values 
specified as variables X, Y and Z. 

When the navigation information storage unit 3203 
stores NVTs (X), (Y), (Z), and (0,1), the reception con- 
trol unit 3205 reads out the script information of NVT 
(0,1), sends the graphics data of NVTs (X), (Y). (Z), and 
(0, 1) to the reproduction control unit 3204 in accordance 
with the read script information, instructing to combine 
the sent graphics data with the image data and display 
the composite image. 

On receiving signals from the user via the remote 
controller and the signal reception unit 107, the recep- 
tion control unit 3205 sets variables A1 , A2, and A3 to 
certain values in accordance with the input operation 
specified in the script information (see FIG.35). When it 
pasts time t6 after the above values have been set, the 
reception control unit 3205 stores a filter condition in the 
filter condition storing unit 1 12 to fetch NVT (0,2). 

When the navigation information storage unit 3203 
stores NVT (0,2), the reception control unit 3205 sends 
the graphics data of NVT (0,2) to the reproduction con- 
trol unit 3204 with an Instruction to combine the sent 
graphics data with the image data and display the com- 
posite image. 

The reception control unit 3205 reads out the tele- 
phone number of the broadcast station from the appara- 
tus information storage unit 3202 and connects the 
broadcast reception apparatus 3201 to the broadcast 
station via the modem 3206 and the public network 
3207. The reception control unit 3205 then transmits the 
values of variables X, Y, Z, A1 , A2, and A3 to the broad- 
cast station. 

Modem 3206 Is used to connect the broadcast 
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reception apparatus 3201 to the broadcast station (not 
sliown in the drawings) via the public networl< 3207. 

The following is a description of specific display 
operations on the display unit 110. FIG.36 shows an 
image displayed on the display unit 1 1 0 during a period s 
between time t1 and time t2 after the user selects and 
enters the questionnaire program. FIG.37 shows an 
image displayed on the display unit 110 during a period 
between time t2 and time 16 after the user inputs infor- 
mation using the remote controller 1 13 that the user is io 
female, 20 or more In age, and lives in the Kansai dis- 
trict. Note that the background has changed. 

During the period between time t2 and time t6, the 
user answers to the questions using keys on the remote 
controller 113, such as"i," and "enter." The recep- is 
tion control unit 3205 converts the received information 
into certain values and, after time 16, transmits the val- 
ues to the broadcast station via the modem 3206. 

FIG.38 shows an image displayed on the display 
unit 110 during a period between time t2 and time 16 20 
after the user inputs information that the user is male, 
20 or more in age, and lives in the Kanto district. 

Now, the operation of the present embodiment is 
described with reference to the flowchart shown in 
FIG.39. 25 

The reception control unit 3205 stores a filter condi- 
tion in the filter condition storing unit 112 to fetch the 
video stream 3302 when the questionnaire program is 
selected and entered (S3902). 

The reception control unit 3205 then stores a filter 30 
condition In the filter condition storing unit 112 to fetch 
NVT (0,0) as entry navigation Information (S3904). 

After the user enters his/her sex, age, and address 
on the screen shown in FIG.36, the reception control 
unit 3205 sets variables X, Y, and Z to certain values 3S 
and sets variables A1, A2, and A3 to initial values 
(S3906). 

After time 12, the reception control unit 3205 stores 
a filter condition in the filter condition storing unit 1 1 2 to 
fetch NVT (0,1) (S3908). The reception control unit 4o 
3205 then stores filter conditions in the filter condition 
storing unit 112 to fetch NVTs {X), (Y). and (Z) and 
instructs the reproduction control unit 3204 to combine 
the sent graphics data of NVTs (X), (Y), (Z), and (0,1) 
with the image data and display the composite image « 
(S3910). The reception control unit 3205 continues to 
receive answers from the user to the questions until 
time t6 (S3912). The reception control unit 3205 sets 
variables A1, A2, and A3 to certain values (S3914). 

After time t6, the reception control unit 3205 stores so 
a filter condition in the filter condition storing unit 1 12 to 
fetch NVT (0,2) (S3916). The reception control unit 
3205 then instructs the reproduction control unit 3204 to 
combine the graphics data with the image data and dis- 
play the conposite image, and transmits the values of ss 
variables X, Y, Z, A1 , A2, and A3 to the broadcast sta- 
tion (S3918). This operation procedure ends with this 
process. 
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The present embodiment deals with a question- 
naire program. However, the present embodiment may 
also be applied to a quiz program. Suppose a different 
set of questions are given to each of two types of 
respondents (users), with three questions per screen. 
The combination Is represented as 2x2x2=8. If the com- 
bination should be an-anged in the broadcast station 
side, the broadcast station needs to provide eight 
pieces of navigation Information. On the other hand, if 
the broadcast reception apparatus 3201 arranges the 
three questions for each user type, the combination of 
the questions is represented as 3x2=6. When this hap- 
pens, less pieces of navigation information are used to 
provide the same quality of services when the broad- 
cast reception apparatus 3201 creates one piece of 
navigation information with three questions. This leads 
to a cost down of the apparatus due to reduction of the 
capacity of navigation information storage unit 3203. 

As described above, a lot of display patterns are 
gained by combining a small number of pieces of navi- 
gation information in the present embodiment. 

In the present embodiment, the questionnaire text 
is displayed on the display unit 110. However, the text 
may be output as composite tone from the audio output 
unit 1 1 1 so that the user can understand the questions. 

The audio data is not desaibed in detail in the 
above embodiments. Actually, however, the audio data 
is multiplexed in the transport stream and is output from 
the audio output unit 1 1 1 in synchronization with corre- 
sponding Images. 

The navigation information described in Embodi- 
ments 1 -4 may be transmitted from a broadcast appara- 
tus as a navigation information table, such as NVT (0,2) 
shown in FIG.40. 

The navigation information table 4001 shown in 
FIG.40 includes the same contents as NVT (0,2) for the 
navigation information sequence 203 described in 
Embodiment 1 (see FIGs.2 and 3). 

The navigation Information table 4001 includes 
object definition table 4002, handler definition table 
4003, and bitmap table 4004. 

The object definition table 4002 shows types and 
attributes of graphics objects. For example, "button" is 
one type of the graphics objects. The "Index" column 
shows index numbers for objects. The "type" column 
shows types of the graphics objects. The "X" and "Y" 
columns respectively show the coordinate values of dis- 
play standard positions on the display screen. The "han- 
dler" column shows index numbers for handlers which 
are executed when corresponding objects are selected. 
The "normal bitinap" column shows index numbers for 
bitmaps which are displayed when corresponding 
objects are in normal state. The "focused bitmap" col- 
umn shows index nuntoers for bitmaps which are dis- 
played when corresponding objects are in selected 
state. The normal state indicates that the corresponding 
object is merely displayed. The selected state indicates 
that the corresponding object is selected. 
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For example, the object definition table 4002 Indi- CI; 
cates that for the object with index number "0," the han- 
dler with index number "3" is executed, that in the i. 
normal state, the bitmap with index number "6" Is dis- 
played, and that in the selected state, the bitmap with s 
index number "7" is displayed. This is similarly applied 
to the objects with index numbers "1" and "2." 

The handler definition table 4003 shows scripts 
which each define operations of the broadcast reception 
apparatus 101 related to user operations. io 

For exanple, the script for the handler with index 
number "3" states "PlayAudio("BEEEEE")." This script 
defines an Instruction to output composite tone of a 
buzzer. 

The bitmap table 4004 shows bitmap data which is 15 
graphics data superimposed on video image data by the 
broadcast reception apparatus 101 , where the bitmaps 
in the bitmap table 4004 correspond to those in the 
object definition table 4002. 

For example, the bitmap with index number "6" in bo 
the bitmap table corresponds to the normal bitmap for 
the object with index number "0" in the object definition 
table 4002. 

Note that the "input operation" defined in NVT (0,2) 
of Embodiment 1 (see the script information shown in 2s 
FIG.3) Is achieved by handlers in the navigation infor- 
mation table 4001 of FIG. 40. Accordingly, the value 
specified as variable X in Embodiment 1 has no sub- 
stantial meaning. 

The navigation information in the above embodi- so 
ments does not define hyperlink information. However, 
a hyperlink table showing link targets may be used 
when the navigation information defines hyperlink infor- 
mation. 

The broadcast reception apparatus 101 or the like 35 2. 
described in Embodiments 1-4 may be recorded as a 
program in a record medium, such as a HOM card, the 
program realizing the functions of the reception control 
unit, the reproduction control unit, and other elements 
shown in FIG.1. This enables a broadcast reception 4o 
apparatus to have the functions of the broadcast recep- 
tion apparatus 101 of the present invention by inserting 
the ROM card into a card slot of the broadcast reception 
apparatus. 

INDUSTRIAL USE POSSIBILITY 

The broadcast reception apparatus of the present 
invention is very useful in that it can separate only nec- 
essary pieces of navigation information from a transport so 
stream into which video data and a plurality of pieces of 
navigation information are multiplexed and that it can 
generate and display a conposite image using data 
specified by the separated navigation information. The 
function of providing different user interfaces for corre- ss 
spending users has a high practical merit. 



A broadcast reception apparatus for receiving 
broadcast data as a transport stream, wherein the 
transport stream includes video data and a plurality 
of navigation information sequences, each of the 
plurality of navigation information sequences 
includes navigation information which includes 
graphics data to be combined with the video data 
for display, the broadcast reception apparatus com- 
prising: 

extracting means for extracting the video data 
and navigation information from the transport 
stream; 

extract controlling means for controlling the 
extracting means so that the extracting means 
extracts navigation information from one out of 
the plurality of navigation information 
sequences which is related to the broadcast 
reception apparatus; 

navigation information storage means for stor- 
ing the navigation information extracted by the 
extracting means; and 

reproduction controlling means for combining 
graphics data included in the navigation infor- 
mation stored in the navigation information 
storage means with the video data extracted by 
the extracting means and displaying a compos- 
ite image which is a result of this combination. 

The broadcast reception apparatus of Claim 1 fur- 
ther comprising: 

operation receiving means for receiving a user 
operation; and 

apparatus information storage means for stor- 
ing relationships between operation equip- 
ments and a plurality of identifiers of the 
plurality of navigation information sequences, 
the operation equipments being operated by a 
user to send user operations to the operation 
receiving means, wherein 

the operation receiving means includes: 

a signal receiving unit for receiving a signal 
which specifies one out of the operation 
equipments which is used for the user 
operation received by the operation receiv- 
ing means, and 

the extract controlling means includes: 

an extract condition setting unit for obtain- 
ing from the apparatus information storage 
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means an identifier of a navigation infor- 
mation sequence which corresponds to the 
operation equipment specified by the sig- 
nal received by the signal receiving unit 
and setting a condition for extracting navi- 
gation information in the extracting means. 

3. The broadcast reception apparatus of Claim 2, 
wherein 

each of the plurality of navigation information 
sequences includes a plurality of sets of pieces of 
navigation information, the plurality of sets of 
pieces of navigation information corresponding to 
respective time periods, and each set of pieces of 
navigation information being formed by repeatedly 
multiplexing a piece of navigation information dur- 
ing a corresponding time period, and wherein 

the extract condition setting unit sets a con- 
dition for extracting navigation information in 
accordance with a time period. 

4. The broadcast reception apparatus of Claim 2, 
wherein 

the operation equipments are a remote con- 
troller tor adults and a remote controller for children, 
and the plurality of navigation information 
sequences are a navigation information sequence 
for adults and a navigation information sequence 
for children. 

5. The broadcast reception apparatus of Claim 1, 
wherein 

each piece of navigation information 
includes display position information and time infor- 
mation, the display position information indicating a 
position for displaying graphics data, the time infor- 
mation indicating a time period during which graph- 
ics data is displayed, wherein 

the reproduction controlling means com- 
bines graphics data with the video data in accord- 
ance with the display position information and 
displays a composite image in accordance with the 
time information. 

6. The broadcast reception apparatus of Claim 1 fur- 
ther comprising: 

apparatus information storage means for stor- 
ing relationships between display screens and 
a plurality of identifiers of the plurality of navi- 
gation information sequences, the display 
screens displaying the composite image com- 
bined by the reproduction controlling means, 
wherein 

the extract controlling means includes: 

an extract condition setting unit for receiv- 
ing information indicating one out of the 
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display screens from the reproduction con- 
trolling means, obtaining from the appara- 
tus information storage means an identifier 
of a navigation information sequence 
5 which corresponds to the display screen 

indicated by the information received from 
the reproduction controlling means, and 
setting a condition for extracting navigation 
information in the extracting means. 

10 

7. The broadcast reception apparatus of Claim 6, 
wherein 

the display screens includes a wide screen 
with aspect ratio 16:9, a normal screen with aspect 
15 ratio 4:3, and a small-scale LCD (Liquid Crystal 
Display), 

navigation information corresponding to the 
wide screen includes display position information 
which indicates a position for displaying graphics 

20 data, the position being a right-hand side and a left- 
hand side blank areas generated when a normal- 
size image is displayed on the wide screen, naviga- 
tion information corresponding to the normal 
screen includes display position information which 

25 indicates a position for displaying graphics data, the 
position being a top and bottom blank areas gener- 
ated when a wide-size image is displayed on the 
normal screen, and navigation information con'e- 
sponding to the small-scale LCD includes display 

30 position information which indicates a position for 
displaying graphics data, the position being almost 
a whole display area, 

the extract controlling means includes: 

35 a size receiving unit for receiving image size 

information specifying either of a wide size and 
a normal size concerning an image of the video 
data; and 

40 a display instructing unit for instructing the 

reproduction controlling means to display the 
graphics data on a display screen at a position 
indicated by the display position information in 
accordance with the information indicating one 

45 out of the display screens received from the 

reproduction controlling means and in accord- 
ance with the image size information received 
by the size receiving unit. 

50 8. The broadcast reception apparatus of Claim 1 fur- 
ther comprising: 

operation receiving means for receiving a user 
operation; 

55 a modem connected to a public network; and 

apparatus information storage means for stor- 
ing a telephone number of a connection desti- 
nation to which the modem is connected. 
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wherein 

the extract controlling means includes: 

an authority checking means for reading 
the telephone number, connecting to the s 
connection destination by the modem, and 
checking whether a pay broadcast pro- 
gram is to be viewed when the extracting 
means extracts video data of the pay 
broadcast program and the operation io 
receiving means receives a user operation 
indicating that the user selects the pay 
broadcast program; 

a first extract condition setting unit, when 
the authority checking means receives a 15 
confirmation that the pay broadcast pro- 
gram is to be viewed, for setting a condition 
In the extracting means for extracting navi- 
gation information included In a navigation 
information sequence related to the confir- 2o 
mation that the pay broadcast program is 
to be viewed; and 

a second extract condition setting unit, 
when the authority checking means 
receives an answer that the pay broadcast 25 
program is not to be viewed, for setting a 
condition in the extracting means for 
extracting navigation information included 
in a navigation Information sequence 
related to the answer that the pay broad- 30 
cast program is not to be viewed. 

9. The broadcast reception apparatus of Claim 8, 
wherein 

the authority checking means receives infor- 35 
mation of a permitted audience time period 
together with the confirmation that the pay broad- 
cast program is to be viewed, 

the extract controlling means Includes: 

a timer unit for activating the second extract 
condition setting unit when the permitted audi- 
ence time period has expired. 

10. A broadcast reception apparatus for receiving 45 
broadcast data as a transport stream, wherein the 
transport stream includes video data and a plurality 

of pieces of navigation information which includes 
graphics data to be combined with the video data 
for display, the broadcast reception apparatus com- so 
prising: 

operation receiving means for receiving a user 
operation; 

55 

extracting means for extracting the video data 
and navigation information from the transport 
stream; 



extract controlling means for controlling the 
extracting means so that the extracting means 
extracts two or more pieces of navigation infor- 
mation out of the plurality of pieces of naviga- 
tion information in accordance with the user 
operation received by the operation receiving 
means; 

navigation information storage means for stor- 
ing the two or more pieces of navigation infor- 
mation extracted by the extracting means; and 

reproduction controlling means for combining 
graphics data included in the two or more navi- 
gation information stored in the navigation 
information storage means with the video data 
extracted by the extracting means and display- 
ing a composite image which is a result of this 
corrtoination. 

11. The broadcast reception apparatus of Claim 10, 
wherein 

the user operation received by the operation 
receiving means is a user attribute, and 

each of the plurality of pieces of navigation 
information includes graphics data corresponding 
to a user attribute. 

12. The broadcast reception apparatus of Claim 1 1 fur- 
ther comprising: 

a modem connected to a public network; 
apparatus information storage means for stor- 
ing a telephone number of a connection desti- 
nation to which the modem is connected; and 
transmitting means for transmitting data to the 
connection destination by the modem, the data 
corresponding to a response by a user to the 
graphics data displayed by the reproduction 
controlling means. 

13. A record medium to be used for a broadcast recep- 
tion apparatus, wherein the broadcast reception 
apparatus receives broadcast data as a transport 
stream, the transport stream includes video data 
and a plurality of navigation information sequences, 
each of the plurality of navigation information 
sequences includes navigation information which 
includes graphics data to be combined with the 
video data for display, the broadcast reception 
apparatus comprises: an extracting unit for extract- 
ing the video data and navigation information from 
the transport stream; and a navigation information 
storage unit for storing the navigation information 
extracted by the extracting unit, 

a program is recorded in the record medium, 
the program includes: 
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an extract controlling step for controlling 
the extracting unit so that the extracting 
unit extracts navigation information from 
one out of the plurality of navigation infor- 
mation sequences which is related to the 5 
broadcast reception apparatus; and 
a reproduction controlling step for combin- 
ing graphics data included in the naviga- 
tion information stored in the navigation 
information storage unit wUh the video data 10 
extracted by the extracting unit and dis- 
playing a composite image which Is a 
result of this combination. 

14. A record medium to be used for a broadcast recep- 16 
tion apparatus, wherein the broadcast reception 
apparatus receives broadcast data as a transport 
stream, wherein the transport stream includes 
video data and a plurality of pieces of navigation 
information which includes graphics data to be 20 
combined with the video data for display, the broad- 
cast reception apparatus comprises: an extracting 
unit for extracting the video data and navigation 
information from the transport stream; and a navi- 
gation information storage means for storing two or 25 
more pieces of navigation information extracted by 
the extracting means, 

a program Is recorded in the record medium, 

the program includes: 30 

a determining step for determining a user 
operation; 

an extract controlling unit for controlling the 35 
extracting unit so that the extracting unit 
extracts the two or more pieces of naviga- 
tion information out of the plurality of 
pieces of navigation Information in accord- 
ance with the user operation determined in 40 
the determining step; 

a combining step for combining together 
two or more pieces of graphics data 
included in the two or more navigation 45 
information stored in the navigation Infor- 
mation storage unit; and 

a combination displaying step for combin- 
ing the graphics data combined in the com- so 
bining step with the video data extracted by 
the extracting unit and displaying a com- 
posite image which is a result of this com- 
bination. 
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